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(57) ABSTRACT 

The present invention relates to a novel interactive infor- 
mation system which can be used to make a traditional print 
medium such as a magazine, "interactive". When the tradi- 
tional print medium is placed on a print media receiving unit 
in a predetermined position, a user can interact with the 
traditional print medium. Printed matter elements on the 
printed medium can be made "selectable" by the user. 
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PRINT MEDIA INFORMATION SYSTEM can then be scanned using a scanner and a computer can 

WITH A PORTABLE PRINT MEDIA obtain auxiliary information from the Internet using the 

RECEIVING UNIT ASSEMBLY URL. 

Printing many specialized machine readable codes such as 

CROSS REFERENCE TO RELATED 5 multiple barcodes or digital watermarks on a print medium 

APPLICATIONS such as a magazine, however, has a number of disadvan- 

This application claims the benefit of the U.S. Provisional tages For example having many barcodes or watermarks in 

Patent Application No. 60/200,715 filed Apr. 27, 2000, a pmt medrum makes ^rmtnig process for me parUcular 

which is herein incorporated by reference in its entirety for 1(1 ? nal m « hum ™" more expensive. Tne 

all u oses increased cost will likely deter many publishers from pnnt- 

ing many the machine readable codes in their publications. 

FIELD OF THE INVENTION Moreover, the visual appearance of a print medium is 

significantly compromised when the print medium includes 

Embodiments of the invention relate to systems and multiple barcodes. Pages of a magazine, for instance, appear 

methods for interacting with or augmenting print media. 15 cluttered to a reader and thus less visually pleasing when 

many barcodes are present. Furthermore, if the barcodes or 

BACKGROUND OF THE INVENTION watermarks are blurred in some manner in the printing 

"Hard copy" print media such as paperback books have a P™™s &* s ™ may not be able to scan the barcode and 

number of advantages over electronic publications. Some „ obtain the mxih ^ informat30n - 

electronic books, for example, can be read using a device Embodiments of the invention address these and other 

such as a personal digital assistant (PDA). However, the problems. 

screens of PDAs are very small and it can be difficult to read SUMMARY OF THE INVENTION 
the text of books on the PDAs. Moreover, it is difficult to 

manipulate the pages of an electronic book as a user must 2$ Embodiments of the invention can provide auxiliary 

scroll through a number of pages to get to a page of interest. information to a user, conveniently and efficiently. The 

It is often faster for the user to turn a page of an ordinary auxiliary information is provided to the user without sig- 

book to quickly get to the desired page. Because the pages nificant effort on the part of the user. Moreover, in embodi- 

of an ordinary book can be turned quickly, the user can ments of the invention, a "hard copy" print medium is used, 

understand the context of a story or article that occupies 3Q The benefits of a traditional hard copy print medium are 

many pages of the book much more quickly than would retained while gaining the ability to efficiently retrieve 

otherwise be the case when turning the pages of an elec- auxiliary information related to the print medium and per- 

tronic book. Furthermore, although improvements have form actions related to the print medium, 

been made to electronic display screens in recent years, One embodiment of the invention is directed to a print 

printed matter on paper is often easier for people to read than 35 media information system. The system comprises: (a) a print 

electronic print on an electronic display screen. For instance, media receiving unit including (i) a surface suitable for 

glare on an electronic display screen can make an electronic receiving a print medium, and (ii) an electronic position 

book difficult to read. Paper, on the other hand, typically determining system capable of determining a position of a 

does not produce excessive glare. Lastly, although sales of selected portion of the print medium when the print medium 

electronic publications are increasing, sales of traditional 4Q is disposed on the surface; and (b) an information server 

print media remain very high indicating a continuing con- computer adapted to perform a task after receiving the 

sumer preference for hard copy print media. One reason for information relating to the position of the selected portion of 

this may be that traditional print media are typically easier the print medium. 

to use than electronic print media. Another embodiment of the invention is directed to a 

Although hard copy printed media have many advantages 45 method of interacting with a print medium. The method 

over electronic publications, hard copy printed media have comprises: (a) receiving information relating to a position of 

a number of limitations. For example, the information which a selected portion of a print medium on a surface of a print 

can be present in a hard copy printed medium such as a media receiving unit comprising an electronic position 

magazine is limited to the number of pages within it. If the determining system; and (b) performing a task after receiv- 

reader wants additional information about a particular sub- 50 ing the information relating to the position of the selected 

ject being read, the reader must take the time search for the portion of the print medium. 

information. For example, if a reader wants more informa- Another embodiment of the invention is directed to a print 

tion about a product in a story or an advertisement that he or media receiving unit. The unit comprises: a surface capable 

she sees in a magazine, the reader must take affirmative steps of receiving a print medium; an electronic detection system 

to locate the additional information. The reader can contact 55 capable of detecting a section of a portion of the print 

the seller of the product by mail, phone or the Internet to medium by a user when the print medium is disposed on the 

obtain additional information about the particular product surface; a writeable memory device adapted to receive 

advertised. The additional effort undertaken by the reader is auxiliary information from an information server computer; 

very inconvenient to the reader. Moreover, the retrieval of and an output device adapted to communicate the auxiliary 

the additional information is delayed by the time needed to 60 information to a person. 

determine how to obtain the information as well as the time Another embodiment of the invention is directed to a print 

needed to actually obtain the information. mcdia information system. The system comprises a print 

To address this problem, some have suggested printing media receiving unit including (i) a surface suitable for 

specialized machine readable codes such as barcodes or receiving a print medium, and (ii) an electronic detection 

digital watermarks containing embedded information of a 65 system capable of detecting a selection of a portion of the 

uniform resource locator (URL) on the pages of a print print medium by a user when the print medium is disposed 

medium such as a magazine. The barcodes or watermarks on the surface; (b) an information server computer; and (c) 
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a print media database on or accessible to the information DETAILED DESCRIPTION 

server computer. Embodiments of the invention can be used to make a 

Another embodiment of the invention is directed to a traditional print medium such as a magazine, "interactive", 

method of augmenting a print medium. The method com- When the traditional print medium is placed on a print media 

prises: (a) electronically encoding information relating to 5 receiving unit in a predetermined position, a user can 

portions of a print medium; and (b) sending the information interact with the print medium by selecting print elements on 

relating to the portions of the print medium to a user via a toe medium. For example, a user can use a stylus to 

communication medium, wherein the sent information is to select ( for example, by touching) a symbol for a stock on the 

be used in a print media receiving unit comprising an P rint mcdium wh >l c it is disposed on the print media 

electronic detection system capable of detecting a selected 10 receiving unit. Auxiliary information such as the latest price 

portion of the print medium when the print medium is the stock can be Panted to the user in audio or visual 

disposed on the surface. form m res P onse to the selection. The auxiliary information 

i may come from a server computer and may be provided to 

These and other embodiments are discussed in further me print media reC eiving unit before or after the user makes 

detail below. ^ a selection. Advantageously, portions of the print medium 

can "selected", even though the print medium is free of 

BRIEF DESCRIPTION OF THE FIGURES electronic circuitry. 

FIG. 1 shows a block diagram of a system according to an Tn e auxiliary information may be created by the publisher 

embodiment of the invention. °f mc P 1 " 11 medium. The publisher may associate any type 

FIGS. 2 to 4 show flowcharts illustrating embodiments of 20 or amount of auxiliary information with any desired print 

the invention. elements in the print medium. Auxiliary information may be 

r-i^o «/ \ * */ \ i i r static or dynamic and generally supplements an associated 

HGS. 5(a) to 5(e) show schematic diagrams or system . * , „ , c _ „ ■ ♦ i . • « . j* 

embodiments print element. Some or all print elements in a print medium 

may be designated selectable by the publisher. 
FIG. 6 shows a schematic diagram of a system embodi- ^ Whcn it is pkccd 0Q me prmt mcdium receiving ^ tne 

ment " print medium can be geometrically "registered". That is, the 

FIG. 7 is a schematic diagram of a print media receiving print medium may be positioned on the print media receiv- 

unit * ing unit in a specified position and orientation. The accuracy 

FIG. 8 is a plan view of a print medium on a print medium of the placement of the print medium on the print medium 

receiving unit embodiment. 30 receiving unit may vary depending on the number or size of 

FIG. 9 is a three-dimensional view of a print medium on selectable print elements on the page, or the distance 

a print medium receiving unit embodiment. between adj acent print elements. If there are many selectable 

print elements on a page of a print medium, then the 

DEFINITIONS registration accuracy needed is typically greater than if there 

As used herein: 35 are fewer selectable print elements per page. For example, if 

"auxiliary information" includes any type of information there is on ly °ne selectable print element per page in a 

which can be used to supplement a selected portion of magazine disposed on the print media receiving unit, then 

a print medium. Auxiliary information may be static or toe registration of the magazine need not be substantially 

dynamic, and can be embodied in an auxiliary appli- accurate. After entering the page number that the user is 

cation or a content package of information. 40 viewing into the print media receiving unit, the user could 

An "auxiliary application" includes a computer applica- usc a stylus to touch virtually any portion of the page to 

tion which relates to a portion of a print medium or is select the print element on that page. In these embodiments, 

provided in response to a selection of a portion of a print toe point at which the stylus touches the page need not be 

medium. Auxiliary applications may run on a print media closc to tl] e selectable print element on the page. On the 

receiving unit, a client computer, or any other component. 45 °toer hand, if there are many selectable print elements on the 

A "communication medium" includes any suitable com- P a £ e > th en more accurate registration is typically needed to 

munication network. Examples of communication media ensure that the selectable print elements are properly regis- 

may include the Internet, subsets of the Internet such as the tered with corresponding positions on the surface of the print 

World Wide Web, intranets, PCS (personal communication media receiving unit. If, for instance, five pictures on a page 

systems), cellular telephone networks, PSTNs (public- 50 are selectable, the five pictures can be registered to five 

switched telephone networks) and non-proprietary and pro- selectable positions on the print media receiving unit. By 

prietary computer networks. doing so, the appropriate supplemental information is pre- 

A "stylus" includes a device which is capable of selecting sented to the user upon the selection of one of the five 

a letter, symbol, graphical patterns, elements of graphical pictures. 

patterns, or other print element. 55 After it is on the print media receiving unit, the user may 

An "information source" includes sources of information select a portion of the print medium. If appropriate, the page 

such as sources of auxiliary information, auxiliary number that the user is viewing may be entered into the print 

applications, and content packages. media receiving unit. A selecting device such as a stylus or 

A "content package" includes a package of information finger can be used to touch or point to printed matter such 

sent to a user. In some embodiments, information and 60 as text, pictures, or symbols in the print medium. An 

applications in a content package can be tailored to a user electronic detection system in the receiving unit may then 

profile or a particular print medium. determine that the user has made a section. In preferred 

A "user package" includes a package of information sent embodiments, an electronic position determining system in 

by a user. the print media receiving unit can determine the position of 

A "print element" can include, alone or in combination, a 65 toe selected portion of the print medium, 

photo, word, phrase, graphic pattern, symbol, paragraph, etc. In some embodiments, a print medium identifier or a user 

in or on a print medium. identifier, and information relating to the position of the 
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selected portion is then sent to an information server com- 
puter. This information may be sent to a client computer 
which is external to the print media receiving unit, before 
being sent to the information server computer. In other 
embodiments, the client computer may be present in the 5 
print media receiving unit so that the print media receiving 
unit can be connected directly to a communication medium 
such as the Internet. In these embodiments, an intervening 
computer unit at the user's location is not needed to com- 
municate with the information server computer. Regardless 10 
of which configuration is used, the print media receiving unit 
and the client computer are preferably located at a first 
location where the user is present, while the information 
server computer is at a second location (e.g., at a remote 
location) away from the user. 15 

The information relating to the position of the selected 
portion may be the information in the selected portion, or 
may be the position of the selected portion in the print 
medium (e.g., the page that a selected print element is on and 
its relative or absolute position on that page). For example, 2 o 
information relating to the position of the selected portion 
may be the particular phrase, picture, etc. selected by the 
user. To determine the particular phrase, picture, etc. 
selected by the user, the print media receiving unit may 
contain an electronic map of the print medium disposed on 2 5 
the print medium receiving unit. The electronic map can be 
stored in a writeable memory in the print media receiving 
unit and can correlate print elements in the print medium 
with their location on the print medium. For example, the 
electronic map may correlate a particular print element to 30 
the page that it is on and its particular location on the page. 
The electronic position determining system can determine 
the position of a portion selected by a user, and a processor 
can determine the actual phrase, picture, etc. selected by the 
user using the position information and the electronic map. 35 
Accordingly, in some embodiments, the print media receiv- 
ing unit can determine both the position of the selected 
portion as well as the actual phrase, picture, etc. selected by 
the user. Alternatively or additionally, the information relat- 
ing to the position of the selected portion may be the relative 40 
or absolute position of the selected portion of the print 
medium. 

In some embodiments, the information server computer 
may perform a task after receiving the information relating 
to the selected portion position. Any suitable task may be 45 
performed by the information server computer. For example, 
the information server computer may retrieve auxiliary 
information relating to the particular portion of the print 
medium selected by the user. The retrieved auxiliary infor- 
mation may then be transmitted to the user by using the 50 
information server computer. The transmitted auxiliary 
information may be received by a client computer at the 
user's location. The client computer may be internal to or 
external to the print media receiving unit, and may present 
the auxiliary information to the user in an audio or visual 55 
format. 

When a user interacts with a print medium on a print 
media receiving unit, a one- or two-way communication 
channel can be created between a user (e.g., a reader of a 
publication) and entities having auxiliary information, aux- 60 
iliary applications, interactive services, and control services 
relating to the print medium with which the user is inter- 
acting. The auxiliary information, auxiliary applications, 
interactive services and the control services can be accessed 
through the information server computer. The information 65 
server computer may be operated by a publisher of the print 
medium or a service provider contracted by the publisher. 
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In other embodiments, the server computer need not 
perform a task after the user selects a print element. For 
example, in some embodiments, the print media receiving 
unit can receive an electronic map and auxiliary information 
for a particular print medium from a server computer. The 
electronic map and the auxiliary information may be down- 
loaded to a client computer at the user's site and then loaded 
into a writeable memory in the print media receiving unit. 
After the auxiliary information and the electronic map are 
received by the print media receiving unit, the user can 
interact with the print medium when it is placed on the print 
media receiving unit without further contact with the server 
computer. At a later date, the user may load different 
auxiliary information and electronic maps for different print 
media into the print media receiving unit. Consequently, in 
some embodiments, the user need not be in direct commu- 
nication with the server computer when interacting with the 
print media receiving unit. 

In an illustrative embodiment, a user may review a 
publication such as a magazine on a print media receiving 
unit and may want to know more about a particular subject 
in the magazine. The user may request back issues contain- 
ing information relating to the particular subject by selecting 
the appropriate portion of the magazine. The information 
server computer is contacted and the information server 
computer may retrieve the back issues (or pertinent portions 
thereof) and may electronically transmit electronic copies of 
the back issues to the user's e-mail account or personal 
information manager (PIM). Alternatively or additionally, 
the publisher may send the back issues in hard copy form to 
the user through a non-electronic form of communication 
such as the U.S. mail. 

As noted above, an electronic detection system can be 
used to determine that the user has made a selection. The 
electronic detection system is preferably an electronic posi- 
tion determining system which can be used to determine the 
position of portions of a print medium selected by a user. 
(Examples of suitable position determining systems are 
provided below.) A number of advantages are A provided by 
using electronic detection system such as this. For example, 
by using a print media receiving unit and a position deter- 
mining system, auxiliary information for any desired portion 
and for any desired print element in the print medium can be 
obtained. Since the location of a selected print element can 
be used to determine what the print element is (rather than 
a characteristic of the print element), the system can deter- 
mine what the selected print element is regardless of the 
particular features of the print element. The ability to 
interact with the print medium is not dependent upon the 
characteristics of the print element. For example, the print 
elements in a print medium need not have a particular shape, 
configuration, or code to render the print medium interac- 
tive. Also, the presence of many print elements such as bar 
codes in a print medium decreases the aesthetic appeal of the 
print medium. Furthermore, eliminating the requirement of 
having specialized print elements saves publishers of print 
media a significant amount of time and expense as special 
printing processes are not needed to make a publication 
interactive. For example, special printing processes to print 
many barcodes or other machine readable symbols in a print 
medium are not needed in preferred embodiments of the 
invention. 

Different types of print media may be used in embodi- 
ments of the invention. Suitable printed media may include 
"hard copy" printed media including publications, graphical 
patterns, game boards, photo albums, etc. Examples of 
publications include magazines, books, resumes, flyers, 
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workbooks, manuals, newspapers, television guides, theater 
guides (or other performance guides), test forms, annual 
reports, direct mail items, music sheets, music or entertain- 
ment reviews, children's books, game or puzzle sheets, 
monthly statements, publications, etc. 5 

The pages of the print media may comprise any suitable 
substrate material including paper or plastic. Print elements 
such as letters, figures, drawings, icons, symbols, pictures, 
etc. may be printed on the substrate material using any 
suitable ink, dye, or other print material. The print in the 10 
printed medium is preferably permanently affixed to the 
substrate material as is ink on paper. If the print medium is 
a book, the book may have a spine which permits the pages 
to lie flat when the book is open. An example of such a spine 
is one made from a spiral wire. 15 

The print medium may even be a transparency sheet with 
printed matter. In some embodiments, a print medium such 
as a transparency may be disposed on a print media receiv- 
ing unit. An image of the printed matter on the transparency 
on the print medium receiving unit can be projected onto a 20 
screen away from the print medium receiving unit using 
conventional methods. The user may interact with the pro- 
jected image on the screen by selecting particular portions of 
the print medium on the print media receiving unit. If 
desired, the pages of the print medium can be turned 25 
automatically while on the print media receiving unit using 
mechanisms well known in the art. The images of the turned 
pages can be displayed on the projection screen, and the user 
can interact with print elements on the pages. 

The print medium may have any suitable size. A suitable 
print medium may have planar dimensions of up to 20 inches 
by 12 inches, or larger (when open or closed). In other 
embodiments, the print medium may be about 10 inches by 
12 inches, 8.5 inches by 11 inches, or 5 inches by 7 inches. 35 
Of course, the print medium may be smaller or larger than 
these sizes. The print medium may also include any suitable 
number of pages. For example, a print medium may have 
more or less than 100 pages. The print medium are prefer- 
ably less than about two inches in thickness, but may be 4Q 
thicker. 

Some or all of the print elements in a print medium may 
be rendered selectable. For example, more of less than one, 
two, or three print elements per page may be rendered 
selectable. If some print elements are rendered selectable 45 
and some are not, the selectable print elements may have a 
different appearance to the user than the non-selectable print 
elements. For example, highlighted, colored differently, 
bolded, or changed text (e.g., italics) might be rendered 
selectable while print elements on the page may not be 50 
rendered selectable. Also, certain portions of the print 
medium may be rendered selectable to generate one 
response, while other portions of the print medium may be 
rendered to generate a response of a different type. For 
example, after selecting highlighted or bolded text in a print 55 
medium such as a magazine, a response providing additional 
information about the highlighted or bolded text may be 
presented to the user. Other portions of the print medium, 
such as the border of the pages of a magazine, might be 
selected by the user and the system may respond to the 60 
selection in different manner or mode. For example, if the 
user selects these other portions, the print media receiving 
unit may respond by playing music or by providing instruc- 
tions to the user (e.g., informing the user to select another 
portion). 65 

FIG. 1 shows a system according to an embodiment of the 
invention. In this embodiment, client computers 71, 72 may 
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be operatively coupled to an information server computer 80 
through a communication medium 70 such as the Internet. 
The information server computer 80 may access an auxiliary 
information database 83 or a Web site 84 which has access 
to another auxiliary information database 85. The Web site 
84 may be run on another information server computer (not 
shown). Auxiliary information from the auxiliary informa- 
tion database 85 can be sent to the client computer 71, 72 via 
the communication medium 70. This can be done directly or 
indirectly through the information server computer 80. The 
information server computer 80 may also have access to a 
print media database 82 containing electronically processed 
print media 82. Any of the databases of information can be 
present on a high-capacity information storage medium. 
Examples of information storage media include optical, 
magnetic, or electrical cartridges, disks, or compact disks. 

Electronic content for the print medium may reside in a 
database 82 accessible to the information server computer 
80. The electronic content for the print medium may include, 
among other things: (a) identifier information for the print 
medium; (b) electronic maps for the print medium; and (c) 
auxiliary information which may be embodied or present as 
static information, auxiliary applications, and/or content 
packages relating to predetermined print elements in the 
print medium. 

The information server computer 81 may also include a 
host Web site 81. In preferred embodiments, the client 
computers 71, 72 may contact the information server com- 
puter 80 by contacting the host Web site 81. Contact can be 
made by entering the appropriate URL for the Web site 81 
into the client computers 71, 72. Each of the client comput- 
ers 71, 72 can be coupled to a print media receiving unit 73, 
74. In other embodiments, the client computers 71, 72 may 
be included within respective print media receiving units 73, 
74 so that the print media receiving units can be coupled to 
a computer network, without an intervening local computer 
unit. Various output devices (e.g., display devices, audio 
devices) and input devices (e.g., keyboard, mouse, stylus) 
(not shown) can be operatively coupled to the client com- 
puters 71, 72 or the print media receiving units 73, 74 for the 
user to provide and receive information from the system. 

The information server computer used in the system is 
typically a powerful computer or cluster of computers. For 
example, the information server computer can be a large 
mainframe, a minicomputer cluster, or a group of servers 
functioning as a unit. For instance, the information server 
computer may be a database server coupled to a Web server. 
Moreover, the information server computer can behave as a 
single computer which services the requests of one or more 
client computers. The information server computer can 
retrieve specific information from an information storage 
medium on or accessible to the information server computer. 
Client computers can communicate with the information 
server computer through the Internet and optionally through 
one or more ISPs (Internet service providers). The client 
computers in the system typically have less memory and less 
computing power than the information server computer. 

An illustrative method embodiment can be described with 
reference to FIGS. 1 and 2. Auser can place a print medium 
on a print media receiving unit 73 (step 91). The user may 
manually or automatically enter an identifier for the print 
medium, and a user identifier or a print media receiving unit 
identifier, into the print media receiving unit 73 or a client 
computer 72 coupled to the print media receiving unit 73. 
For example, a machine readable symbol may encode an 
identifier for the print medium. The machine readable sym- 
bol can be scanned into the system so that the identifier for 
the particular print medium is entered. 
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The location of the information server computer 80 may 
also be entered into the system so that the identifiers can be 
sent to an information server computer 80. For example, the 
print media receiving unit 73, the client computer 72, or the 
print medium may contain or receive a URL for the par- 5 
ticular information server computer 80 to be contacted. The 
URL can be used by the print media receiving unit 73 or the 
client computer 72 to establish communication with the 
information server computer 80. The client computer 72 can 
then transmit the identifiers to the information server com- 1Q 
puter 80 via the communication medium 70. Preferably, the 
client computer 72 contacts the information server computer 
80 by first contacting a host Web site 81 residing on the 
information server computer 80. After receiving the 
identifiers, the information server computer 80 can send an 15 
acknowledgement to the client computer 72 or the print 
media receiving unit 73 that the identifiers have been 
received (step 97). 

Some or all of the electronic content for the print medium 
may be sent to the user after the identifier information is 2 o 
received by the information server computer 80. For 
example, electronic content in the form of a content package 
for the print medium may be downloaded to the user's client 
computer 72 or the print media receiving unit 73. The 
downloaded information may then be transferred to a write- 2 5 
able memory device (not shown) operatively associated with 
the print media receiving unit 73. 

In some embodiments, the downloaded information 
includes an electronic map correlating the print elements in 
the print medium to their location in the print medium, and 30 
auxiliary information for the print elements. In some of these 
embodiments, further information need not be downloaded 
from the information server computer for the user to interact 
with the print medium. The auxiliary information associated 
with the print elements in the print medium may be stored 35 
in a writeable memory device associated with the print 
media receiving unit. The print media receiving unit can 
then present auxiliary information stored in the writeable 
memory to the user after the user selects a print element in 
the print medium. This can be done without further substan- 40 
tial communication with the information server computer 
80. In these embodiments, the user can interact with the print 
media receiving unit 73 without being in direct communi- 
cation with the server computer 80. 

In other embodiments, only a portion of the electronic 45 
content for the print medium need be downloaded to the user 
for the user to interact with the print medium. For instance, 
the auxiliary information relating to print elements in the 
print medium and the electronic map correlating the print 
elements to their location need not be downloaded to the 50 
user. The auxiliary information and/or electronic map may 
be at a location away from the user's site (e.g., in a print 
media database 82). Illustratively, the user can select the 
name of a company on a page in a print medium. An 
electronic position determining system associated with the 55 
print media receiving unit 73 determines the position of the 
selected company name. The positional information is trans- 
mitted from the print media receiving unit 73 to the client 
computer 72, which in turn can transmit it to the information 
server computer 80. Using a previously received print 60 
medium identifier, an electronic map for the print medium, 
and the received position information, the information 
server computer 80 determines that the company name from 
a database has been selected by the user. The information 
server computer may then retrieve auxiliary information 65 
relating to the company name, and the auxiliary information 
can be sent to the user. 
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Again with reference to FIG. 2, the user may use a stylus 
or other selecting device to select portions of the print 
medium (step 94). When selecting a print element, the user 
can use the stylus to contact or nearly contact a print element 
such as a word, phrase, picture, etc. on the print medium. 
After a selection is made, information relating to the position 
of the selected portion of the print medium is then sent from 
the print media receiving unit 73 to the information server 
computer 80 (step 95). For example, as noted above, infor- 
mation of the location of the selected portion may be sent to 
the information server computer 80 or the information of the 
actual selected print element may be sent to the information 
server computer 80. 

The information server computer 80 may then perform a 
task after receiving information relating to the position of 
the selected portion of the print medium. For example, the 
information server computer 80 may retrieve auxiliary infor- 
mation for the user (step 98). The information server com- 
puter 80 can retrieve the information by contacting an 
auxiliary information database 83 or another Web site 84 
having access to another auxiliary information database 85. 
The retrieved information is then sent to the print media 
receiving unit 73 and is provided to the user (steps 96, 99). 
The retrieved auxiliary information may be provided to the 
user in an audio or visual format. 

The auxiliary information retrieved for the user may 
comprise any suitable information. Suitable information 
includes background information, factual information, 
supplemental information, or other information related to 
the print element selected by the user. For example, a user 
may obtain more information about an advertised item 
pictured in a publication or may want to order the advertised 
item. By selecting a print element such as an image of the 
advertised item in the publication, the user can cause the 
information server computer to send auxiliary information 
such as the price or availability of the item to the user. 

The auxiliary information for a print medium may corre- 
spond to the identifier for print medium and may be stored 
according to the identifier. As noted above, the print medium 
identifier may be present or encoded at a standard location 
on the print medium. In some embodiments, the print 
medium identifier may be, for example, the title and date of 
publication of a print medium. In other embodiments, the 
identifier may be an alpha-numeric identifier which has been 
assigned to the print medium and can be encoded in a 
machine readable symbol. In some embodiments, the iden- 
tifier may contain or have associated with it, the location 
(e.g., a URL) where the electronically encoded print infor- 
mation for the print medium can be received. For example, 
when a print medium identifier is entered (manually or 
automatically) into the system, the print media receiving 
unit or a client computer coupled to the print media receiv- 
ing unit establishes contact with the information server 
computer which, in turn, contacts the database where the 
electronic content for the print medium resides. The infor- 
mation server computer can retrieve auxiliary information 
for the print medium, and then send it to the user. 

The auxiliary information may be in any suitable form. 
The auxiliary information may be music or voice data that 
is capable of being converted to music or speech at the user's 
site. For example, in some embodiments, a speaker associ- 
ated with the print media receiving unit can transfer music, 
voice or data into sound. The auxiliary information may also 
comprise text or other graphic material that can be displayed 
on a display device at the user's site. In some embodiments, 
the auxiliary information consists primarily of, or solely of, 
audio information. 
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The auxiliary information may even be provided by a 
computer application which is downloaded to the user's 
computer or print media receiving unit in response to the 
selected print element. The computer application may run on 
these or other components to provide the user with auxiliary 5 
information relating to the selected print element. In one 
example, the computer application may instruct the infor- 
mation server computer to query another Web server for 
additional information about the selected print element. In 
another example, the computer application may provide a 
multimedia presentation to the user, when it is run at the 
user's site. 

In some embodiments, auxiliary applications may be 
downloaded to the print media receiving unit when certain 
symbols, e.g., on the print media or on the surface of the 15 
printed media receiving unit, are selected. For example, 
touching the stylus to a musical note symbol in a short boxed 
story on tempered musical scales, might cause an applica- 
tion program to be downloaded. The application program 
may be run on the print media receiving unit. When run, the 2Q 
program causes a device to illustrate the concept of different 
tonal tempering, and may ask the user to distinguish between 
half tones and whole tones. 

A number of specific examples of auxiliary information 
can be provided. For example, in the case of a magazine or 2 5 
direct mail catalog, the auxiliary information may include 
weather or temperature information at particular travel 
destinations, stock quotes, inventory availability, or daily 
sales. For a news journal, the auxiliary information may 
include historical background to a published story, or related 30 
information, such as music or recorded speeches. In a 
magazine, an advertiser may provide supplemental informa- 
tion on the product for sale, and may also prompt the user 
for additional information. Using the system, the advertiser 
may offer the user an opportunity to purchase goods or may 35 
send an e-mail with additional information to the user. In yet 
another example, the publisher of a print medium capable of 
being used to play a game (e.g., a crossword puzzle) may 
provide auxiliary information about the game to be played 
(e.g., hints, facts about an identified word, etc.). 40 

The auxiliary information sent to the user may also be 
embodied by a content package which can be sent by the 
information server computer. Content packages may be 
specifically tailored towards the user's interests or the par- 
ticular nature of the print medium. Each content package 45 
may have associated with it, a computer application adapted 
to provide auxiliary information to the user and/or static 
information. For example, after a typical content package is 
sent to the print media receiving unit, the unit may ask the 
user to provide responses to a number of queries. Examples 50 
of requested information may include the user's opinion 
regarding a certain subject, answers to a quiz, etc. Informa- 
tion sent by a user may be called a "user package". For 
example, the user may send a user package of information 
to a publisher requesting that several books to be sent to the 55 
user's home and that the items be charged to the user's credit 
card. 

Auxiliary information may also be information sent from 
another person at a different location, which may have been 
prompted, received, or transmitted by an information server 60 
computer. For example, the print medium may comprise one 
or more printed sheets with printed matter corresponding to 
a game which can be played by two players at two different 
locations. The players may operate print media receiving 
units and can interact with the game-containing print media 65 
at their respective locations. Information such as player 
moves can be transmitted between the players using an 
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information server computer. Accordingly, multi-player 
games can be strategy games played in non-real or in 
real-time time across a network, for example, chess or 
Scrabble™ type games where each player's move is logged 
and then transmitted across a communication medium to the 
other player. 

In another example, the print medium may contain a story 
on the stock market in which the user may obtain actual 
stock quotes if the stylus is directed (e.g., touched, pointed) 
to the stock symbols shown in the article. When the user 
selects a particular stock symbol on a page of a magazine on 
the print media receiving unit, information such as a current 
stock price for the selected company's stock can be sent to 
the user in an audio or visual format. Embodiments of the 
invention may thus obtain, real-time auxiliary information 
about certain print items which are time dependent in nature. 

In an example, the user might use a stylus to select a 
picture of an ad for cars in a magazine. In response, the print 
media receiving unit may audibly recite downloaded infor- 
mation regarding the car in the selected ad. The user may, in 
response, select another region of the ad or a region of the 
print media receiving unit to request that additional infor- 
mation about the car be delivered to his e-mail account or 
regular mail box. 

In another example, a publisher may want an article on 
books to have an interactive, i.e. "dynamic" audio content. 
The publisher may want to provide a downloadable appli- 
cation that allows the user to hear excerpts of the books in 
the article when one or more symbols are selected on the 
article. 

Embodiments of the invention also provide the user with 
a variety of control services. For example, by selecting a 
print element on a print medium on a printed media receiv- 
ing unit, the user could request that additional information 
be sent to his e-mail account. In another example, a user 
could also order products using the system. For instance, 
upon touching the stylus to an advertisement for a florist in 
a print medium, the user might request that a flower arrange- 
ment be sent. If the print medium is a catalog, the user could 
request that specific items featured in the catalog be deliv- 
ered to his home by selecting appropriate print element in 
the catalog. 

In some embodiments, the information server computer 
may be operated by a publisher, or a service provider 
contracted by the publisher. The publisher may prepare the 
publication for use in the print media information system by 
going through a series of processing steps. This processing 
may be performed at the information server computer site, 
for example, by a host entity. Alternatively, the processing 
can be performed at a site away from the information server 
computer. A publisher can process a print medium at his site 
and upload the processed print media data to a database for 
storage and retrieval by users. The processing consists of 
entering auxiliary information, auxiliary applications, or 
services associated with predetermined print elements (e.g., 
symbols) in the print medium in an information storage 
medium accessible to or on the information server computer. 
The print medium can be assigned a code that relates the 
print medium to the publisher content or information that the 
publisher wishes to use to supplement the print medium. 

FIG. 3 illustrates a typical process for processing a print 
medium. First, a publisher contacts a processing center 131. 
The publisher obtains an identification code from the pro- 
cessing center that will represent that a particular print 
medium 132. The publisher may then obtain the appropriate 
software to convert the print medium into an electronic 
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format 133. In the preparation process, attachments such as 
static audio, dynamic audio with links, and applets can be 
associated with selectable print elements in the print 
medium. The publisher may then upload this electronic 
content for the print medium to the information server 5 
computer. The information server computer may store the 
electronic content for the print medium in a print media 
database at, e.g., a publisher's site. Then, it can be down- 
loaded by various users 134. In other embodiments, the print 
media database can be operated by a host entity which 1Q 
provides a print media processing service and/or electronic 
content storage service for many different publication enti- 
ties. 

Preferably, the users register with a host entity before 
using the system. With reference to FIG. 4, after obtaining 15 
a print media receiving unit, the user establishes an account 
by registering with a host processing center 121. To establish 
the account, the user can provide the processing center with 
an identifier that is unique to the print media receiving unit 
the user is using. The print media receiving unit identifier is 2Q 
preferably associated with the print media receiving unit 
before it is distributed to the user. In other embodiments, a 
print media receiving unit identifier need not be used to set 
up an account. For example, the user can simply provide a 
user name and password to set up an account. Preferably, the 25 
user then provides the identifier, his name, address, phone 
number, optionally an e-mail address, optionally a list of 
interests, optionally credit card information, and other 
optional personal information to the host processing center. 
After the personal information is sent to the host processing 30 
center, it can be stored in a personal profile which is 
accessible to the information server computer. Whenever the 
user activates the print media receiving unit, the user can be 
identified to the information server computer and, if desired, 
any information retrieved according to the user's personal 35 
profile can be sent to the user. 

The user then takes a print medium which has been 
previously processed by a publisher, and places it on a print 
media receiving unit which has been turned on 122. The 
print medium may have come to the user via a subscription 40 
or by purchase in a retail outlet. The print media receiving 
unit may instruct the user to place the print medium accu- 
rately on the print media receiving unit so it is geometrically 
registered properly. It may also prompt the user to enter the 
identifier of the publication 123. Alternatively, the identifier 4S 
may be read by the print media receiving unit and entered 
automatically when the publication is placed on the print 
media receiving unit. An alpha-numeric entry device asso- 
ciated with the print medium receiving unit can be used by 
the user to enter an identifier code for the print medium 50 
manually into the system. Entry of the identifier may take 
place using the user's fingers or the stylus. 

A print media receiving unit identifier or user identifier 
can be used to identify the user to the system. In either case, 
the identifier could be a code number or other symbol (e.g., 55 
an alpha-numeric symbol). Using the identifier, information 
can be retrieved for the user according to the user's personal 
profile and then sent to the user. Identifiers for both the print 
medium, the print medium receiving unit or the user can be 
sent to the information server computer. After receiving the 60 
identifier, the information server computer can send, e.g., a 
personalized greeting to the user using the corresponding 
print media receiving unit. 

Using a print medium identifier in conjunction with a 
print media receiving unit identifier and/or a user identifier, 65 
a user's experience can be personalized. For example, after 
receiving a print media receiving unit identifier and a print 
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medium identifier, the information server computer may 
download a suggested reading list based on the print 
medium on the print media receiving unit. The suggested 
reading fist may be selected according to preferences in the 
user's personal profile which may be accessible to the 
information server computer. In another example, the user 
may have previously indicated an interest in wines in his 
personal profile. After receiving a magazine and placing the 
magazine on the print media receiving unit, a content 
package prepared according to the user's interests may be 
downloaded into the print media receiving unit. After receiv- 
ing the downloaded content package, the user can be 
informed by the print media receiving unit that an article on 
wines is on a specific page in the magazine. 

A number of different systems can be used to implement 
the above-described embodiments. FIGS. S(a)-5(e) illus- 
trate examples of such systems. In FIG. 5(a), the print media 
receiving unit 2 has a transceiver 28. The transceiver 28 
finks to a second transceiver 30 which in turn is coupled to 
a local external client computer 32. By local, it is meant that 
the client computer 32 and the transceiver 30 coupled 
thereto are close enough to the transceiver 28 in the print 
media receiving unit 2 so that information can be conveyed 
between the transceivers 28, 30 using normal short range RF 
signals. Typically this means that the print media receiving 
unit 2 and the transceiver 30 coupled to the client computer 
32 are in the same home, office, office site, etc. The local 
external client computer 32 is typically a personal computer 
of any type with access to the Internet. The local external 
client computer 32 may be a laptop, local network server 
computer or other type of computer proximate the user's 
site. The local external client computer 32 is preferably 
connected to a communication medium such as the World 
Wide Web 34. In particular, the local external computer 
client 32 is connected to a Web site serviced by an infor- 
mation server computer 10. (The term "connected to the 
Web" is used in the common sense of the phrase and does 
not imply a direct electronic connection.) The connection 
may be through any of the commonly available connection 
services. For example, a modem can be used to call an 
Internet service provider (ISP) which in turn connects to a 
Web site through use of a browser. The information server 
computer 10 has access to a plurality of information sources 
36 which contain auxiliary information, interactive services, 
and related applications associated with print medium. 
Information server computer 10 may also access Web sites 
having access to other information sources. The Web sites 
may be accessed through search engines, hyperlinks, etc. 
There is no practical limit to the number of information 
sources that the information server computer 10 can access. 

FIG. 5(b) is similar to FIG. 5(a), except that in FIG. 5(b), 
a transceiver 30 is coupled to a phone jack 40. The phone 
jack 40 in turn is coupled to a public switched telephone 
network (PSTN) 38. The PSTN may be coupled to the Web 
34 so that the information server computer 10 and the 
information sources 36 can be accessed. 

FIGS. 5(c) and 5(d) are similar to FIGS. 5(a) and 5(b), 
except that a transceiver 30 is coupled to a game station 42 
or an information appliance 44 such as palm-sized computer, 
wireless phone (e.g., cellular phone), personal digital assis- 
tant (PDA), etc. In some embodiments, the information 
appliance 44 may be thin client. In these embodiments, the 
game station 42 and the information appliance 44 may serve 
as client computers. Both the game station 42 and the 
information appliance 44 may be coupled to the Web 34 and 
the information server computer 10 and information sources 
36 can be accessed. 
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The embodiments shown in FIGS. S(a)-5(d) preferably media receiving unit can remain in place. when the print 

use short range RF transceivers. However, RF transceiver media receiving unit is folded. 

links can be replaced by either infrared (IR) links or hard- The print media receiving unit may be formed using any 

wired links. In certain situations it may be more convenient suitable material. The print media receiving unit may be 

to use a hardwire coupling between the print media receiv- 5 formed of plastic, cardboard, or other stiff material. The 

ing unit assembly and the particular device to which it is print media receiving unit may include a conventional 

coupled. leather or vinyl backing that is stiff enough to be used as a 

FIG. 5(e) illustrates, in the last row, a print media receiv- ^^!f onn '. . , . , , 

ing unit 2 coupled to a wireless phone 46 or a PCS (personal J ^ P nDt ™dia "giving unit also includes an electronic 

communication system) node 48 via a transceiver 28 in the w delecUon system such as an electronic position determining 

print media receiving unit 2. Long range RF signals can be s y s ' em ^bedded therein. Using the position of the portion 

used to link the node 48 and the phone 46 with the print of me P™' medlum se ! ected h J tne user , ™ d electronic 

media receiving unit 2. Although the wireless phone 46 and ° f P™ 1 medium the particular printed matter 

the node 48 are shown as being separate from the print selected b y user can be determined by the system. For 

media receiving unit 2, they may also be incorporated into " exa mP le . 38 noted above > the P mt medla receiving unit may 

the print media receiving unit 2. Regardless of the particular contam M electronic map and auxiliary information for the 

configuration used, the cell phone 46 and PCS node 48 may P nnt medium disposed on the print medium receiving unit, 

be operatively coupled to a network such as a PSTN 37 electr ° nic P os ^on determining system can determine the 

which is in turn coupled to the Web 34. The information P oslllon °f a portion selected by a user, and a processor can 

server computer 10 and various information sources 36 can ™ determine the actual phrase, picture, etc. selected by the user 

be accessed. In any of the embodiments, the print media usm S me P 0Sltl0n ^ om ^ on ™d the electronic copy of the 

receiving unit 2 may alternatively use a modem to allow it P nnt medium. Accordingly, m some embodiments, the 

to access a communication medium such as the Web. P" nted media receiving unit can determine both the position 

of the selected portion as well as the actual phrase, picture, 

Print Media Receiving Units and Assemblies 25 ctc - selected by the user. Alternatively or additionally, tbe 

information relating to the position of the selected portion on 

The print media receiving unit may have any suitable a page may be positional information such as the x-y 

shape or size. Preferably, it is in the form of a platform. coordinates of the selected portion on the page. 

Accordingly, a specific example of a print media receiving Information pertaining to the particular page which the 

unit may be referred to as a "platform element". Platform- 3Q user ^ viewing may also be entered into the print media 

shaped print media receiving units have a substantially receiving unit by the user so that the unit knows which page 

planar orientation and also have a substantially planar sur- tne vstT ^ viewing. For example, the user may use a stylus 

face for receiving a print medium. The print media receiving to numbe rs on an alpha-numeric keyboard disposed 

unit may also be about the size of a laptop computer, palm on mc print media rcccivirjg unit . ln anotner embodiment, 

sized, desk top sized, or drawmg board sized. In some 35 tne stylus or otner device can be used to scaQ tne page 

embodiments, the prmt media receiving unit may be in the number of the print medium . In yet mother embodiment, a 

form of a portfolio such as a leather or leather-like portfolio. strip of numbers (0 to 9) may be present on the print media 

The portfolio can be portable and can be carried by persons receiving unit and the user may select the page number using 

and can impart a professional appearance to the print media a stylus by selecting the corresponding combination of 

receiving unit. 40 numberSi j n ye t another embodiment, an indicator such as a 

In some embodiments, the print media receiving unit has "go" circle may be present on the borders of the pages of the 

a surface which is cooperatively structured to receive a print print medium. When the indicator is selected by the user, the 

medium. The surface may form a depression defined by position of the indicator can be determined by the electronic 

edges which are just larger than the planar area of an open position determining system and that position may corre- 

book or magazine fitting within the depression. If the print 45 spond to a particular page in the print medium, 

medium is in the form of a book, the surface of the print Preferred electronic position determining systems include 

media receiving unit may further have an additional depres- graphical location and position determining systems using 

sion conforming to the shape of the spine of the book. When an interactive stylus and an antennae system. For example, 

the book is open, the spine lies in the depression and the m an illustrative embodiment, a magazine may be placed on 

pages of the book lie flat against the surface of the print 50 the print media receiving unit and the user may use a stylus 

media receiving unit. In other embodiments, the surface of 0 r other device to select an advertiser's name in the maga- 

the print media receiving unit need not be cooperatively zme . Upon selection of the advertiser's name using the 

structured to receive a print medium. For instance, a holder stylus, the graphical location and position determining sys- 

can be used to hold a print medium on the surface of the print tem can determine that the user has selected the advertiser's 

medium receiving unit in a fixed position. 55 name. The stylus and an antennae system embedded within 

The print media receiving unit may be hinged at the center the print media receiving unit may interact and determine 

so that it can fold into a unit half, or a fraction of, its opened the particular location of the printed matter selected by the 

size. In use, the print media receiving unit is preferably user. The location of the printed medium and the print media 

opened and a print medium is placed on the open inner faces receiving unit can be fixed relative to each other so that the 

of the print media receiving unit. The print media receiving 60 particular location of printed matter on the printed medium 

unit may also have one or more mechanical features that corresponds to a similar location of the print media receiving 

allow the print medium to be exactly positioned or registered unit. The degree of care taken to achieve overlap of an 

on the print media receiving unit. The print media receiving image, or selectable position, on the print material relative to 

unit may be structured so that when it is closed, it can the detector system in the print media receiving unit will 

enclose a print medium such as a book or a magazine 65 depend on the resolution needed. For example, one region of 

therein. In these embodiments, the print media receiving unit a surface of a print media receiving unit may have many 

can be configured so that a print medium placed on the print selectable positions very close together, while another 
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region of the print media receiving unit surface may have receiving unit may associated with (e.g., contain or be 

few selectable positions. Higher resolution is needed for the coupled to) a transceiver and a local computer such as a 

former than for the latter circumstance. The resolution of the client computer may also have a transceiver. Communica- 

electronic position determining system can be varied accord- ti 0 n can occur between these components via a wireless link 

ing to the algorithm used to interpret the electric field map. 5 between the transceivers. 

In addition to using software to vary the spatial resolution - . _ ,• _ • • „ - + m „ • , , , m v , , 

c ^ & iL - . .1 , ■ lue print media receiving unit may include any suitable 

from page to page, the software can interpret the electnc r* m. • * j* • ■ •* .1 

c u * *l * * j- * • 1 . *^ software. The print media receiving unit assembly may 

field strength map to create a gradient m resolution from one . . , - ^ • 

. r . 4L ™ * fiL 1 , contain word processing software, voice recognition 

part of a page to another. The top or the page, where perhaps c , ... , , * 

1 c * j 1 j 1 . t_i , , j software, position determimng software, etc. 

only a few widely spaced selectable positions are located in A , . , 

may have low resolution, so the print media may be only ^ s * ltable m ? ui devices may be associated with the 

approximately positioned relative to the detector. In contrast, pnnt media receiving unit. Examples of input devices 

the lower portion of the surface may require high resolution mclude * stylus keyboard, mouse, laser pointer, trackball, 

in order to select icons positioned directly on (and thus not touchpads etc. Preferably an mput device such as a stylus 

movable with respect to) the print media receiving unit. This t s 15 electrically coupled to the print media receiving unit. The 

is illustrated in FIG. 8. In yet other embodiments, software ^ mav be tethered and electrically coupled to the prmt 

can modify the operational characteristics of the hardware in med * a ™«> trough a cable or through a 

the graphical location and position determining system so weless hnk to form a P nnt media reiving unit assembly, 

that this gradient can be achieved. Further details of pre- 0ther data m P ut devices may be buttons or selectable 

ferred graphical location and position determining systems 20 symbols (e.g., icons, abbreviations) on the print media 

are described in U.S. Pat. No. 5,686,705, U.S. Provisional receiving unit, which may be selected by the user to obtain 

Application No. 60/200,960 filed May 1, 2000 and U.S. auxiliary information. For instance, the selection of certain 

patent application Ser. No. 09/574,499, now U.S. Pat. No. symbols may cause certain types or modes of auxiliary 

6,661,405, filed May 19, 2000, all of which are herein information to be delivered to the user. The symbols may be 

incorporated by reference in their entirety for all purposes, ^ m a legend on the print media receiving unit so that the user 

and are assigned to the same assignee as the present appli- can easil y reference selectable items. As the user browses a 

cation. In another example, the technology suitable for some P rint medium such as a newsmagazine disposed on a print 

components of a basic print media receiving unit can be media receiving unit, the user may touch a stylus to various 

found in a product called "LeapPad™" commercially avail- * tems of interest on the page. For example, if a news story 

able from LeapFrog, Inc. of Emeryville, Calif. 30 ^ accompanied by a picture of a newsmaker and the reader 

Other types of electronic detection systems can be used. touches the stylus to a displayed icon (e.g., a speaker icon) 
For example, print media receiving unit may have a digital on me P rmt medium receiving unit, auxiliary audio infor- 
graphics tablet or a pressure sensitive surface upon which a mation about me newsmaker may be provided to the user, 
print medium is disposed. Upon pressing the print medium Any suitable audio or visual output devices may be 
and the underlying pressure sensitive surface, the position of 35 associated with the print media receiving unit. Examples of 
the selected portion of the print medium can be determined. visual output devices include a display devices such as video 
In yet another embodiment, a system using surface acoustic screens, monitors, televisions, or LCDs. The audio output 
waves are measured at the edges of a glass plate and are used devices may produce primarily audio output. Examples of 
to calculate the position on the place that was selected by a aud io devices include speakers, earphones, headphones, 
finger or a stylus. In yet another embodiment, an optical 40 voice synthesizers, etc. Audio output devices such as ear- 
detector can be used. The print media receiving unit may phones and headphones can be connected to the print media 
include a frame around a flat surface. The print medium can receiving unit through an audio jack. The print media 
be disposed under the frame and on the flat surface. An array receiving unit preferably contains voice generating technol- 
of light emitters and detectors can be around the inner edges °gy (e.g., a synthesized voice), in addition to voice stream- 
of the frame. When a finger or a stylus is near the print 45 in g or v °i ce pass-through capability. When the stylus 
medium and interrupts light coming from the light emitters, touches words or other printed matter on the print medium, 
the position of the selection can be determined. *n audio device in or coupled to the print media receiving 

The print media receiving unit may also include a write- unit can Provide a high quality human voice, music, and/or 

able memory device. In some embodiments, it contains a sound effects. 

programmable ("flash") memory or other volatile memory 50 FIG. 6 shows a schematic representation of a print media 

device. The write able memory device can store any suitable information system embodiment including a more detailed 

information. For example, electronic maps of print media, as schematic representation of some print media receiving unit 

well as auxiliary information for selected print elements in components. The system comprises a print media receiving 

the print media can be stored in the write able memory unit assembly at a first user location 1(a) and an information 

device. The writeable memory device may be embedded 55 server computer 1(b) at a second location 1(b), The second 

within the print media receiving wit, may be external to the location 1(b) may be remote from the first user location 1(a), 

print media receiving unit, and/or may be temporarily insert- The print media receiving unit assembly may include any 

able within the print media receiving unit If it is temporarily suitable number of components. As shown, the print media 

insertable within the print media receiving unit, it may be in receiving unit assembly may include a platform-shaped print 

the form of a cartridge, disk, memory stick, etc. Preferably, 60 media receiving unit 2, a stylus 4, a processor 6, and a 

such insertable writeable memory devices may also-be writeable memory storage device 8. The stylus 4 may be 

insertable within a client computer. operatively coupled to, and in operative association with, the 

Any of the components in the systems, assemblies and print media receiving unit 2, which is preferably portable. A 

print media receiving units according to embodiments of the wired or wireless link may be present between the stylus 4 

invention may include wireless communication links. The 65 and the print media receiving unit 2. 

links may be provided by, for example, radio frequency or ' The processor 6 may be a microprocessor and is prefer- 

infrared frequency links. In one example, the print media ^bly disposed within the print media receiving unit 2, but 
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may also be external to the print media receiving unit 2. A 
number of operations may be performed by the processor 6. 
For example, the processor 6 may be a component in an 
electronic position determining system (not shown) which 
can be used to determiDe the location of a selected portion 5 
of a print medium disposed on the print media receiving unit 
2. The processor 6 may store instructions for calculating the 
position of the stylus 4 over the print media receiving unit 
2. Alternatively or additionally, the processor 6 may serve as 
a client computer which can receive or transmit data to and 1Q 
from the information server computer 10. Although proces- 
sor 6 is shown as being external to the print media receiving 
unit 2, the processor 6 may be contained within, and/or form 
part of, the print media receiving unit 2. 

A writeable memory storage device 8 is operatively 15 
coupled to the processor 6 and an information server com- 
puter 10. The writeable memory storage device 8 may be 
external to, or disposed within the print media receiving unit 
2. If the writeable memory storage device 8 is disposed 
within the print media receiving unit 2, it may be removable 20 
or non-removable from it. If it is removable, it may be in the 
form of a disk, cartridge, or memory stick. A removable 
memory storage device 8 can be insertable and/or receivable 
by the print media receiving unit 2 and also by an external 
computer (not shown) which may serve as a client computer 25 
communicating with the information server computer 10. 
The writeable memory storage device 8 my also be in the 
form of disk drive, flash memory or other information 
storage device. Any of these forms may be internal to, or 
external to, the print media receiving unit 2. 30 

A stylus 4 may be tethered to a print media receiving unit 
2 to form a print media receiving unit assembly. While the 
stylus 4 is illustrated as being mechanically coupled to the 
print media receiving unit 2, it can also be coupled through 
a wireless link. The stylus 4 may contain electronics that are 35 
operatively coupled to the client computer 6 and the elec- 
tronics in the print media receiving unit 2. In other 
embodiments, the stylus 4 may be free of electronics and 
may simply serve as a mechanical selecting device. 

FIG. 7 shows a schematic diagram of the print media 40 
receiving unit 2. The print media receiving unit 2 shown has 
a hinge 12 in the center that separates two panels and allows 
the priut media receiving unit 2 to fold into a closed position 
when it is not in use. Electronic elements 14 forming part of 
the electronic position locating system are embedded under 45 
the print media receiving unit on each side of the hinge 12, 
and are shown by dashes on the left hand side of the print 
media receiving unit 2. An optional sliding positioning piece 
16 may be used to stabilize and restrain the print media. Any 
suitable positioning structures can be used. For instance, it 50 
is also useful to use notches along the border of the print 
media receiving unit 2 to position a print medium on the 
print media receiving unit 2 in a fixed position. An alpha- 
numeric input region 15 can be provided on the print media 
receiving unit 2 to permit a user to enter data into the 55 
receiving unit. 

On the left hand panel of the print media receiving unit 2, 
three examples of icons 18 are illustrated. These icons might 
be used by the user to make special requests. For example, 
if the user desires additional information about a topic be 60 
sent to his or her e-mail address, the user may select a topic 
in a magazine on the print media receiving unit and may 
later select an e-mail icon. After selecting the e-mail icon, 
the auxiliary information retrieved by the information server 
computer can be sent to the user's e-mail account. 65 
Alternatively, the user might touch the icon 18 to receive an 
audio prompt regarding e-mail. Any number of icons could 
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be used for additional options, and the icons may be printed 
on a surface of the print media receiving unit 2. 

The right side of the print media receiving unit 2 includes 
an optional speaker 20 which is physically integrated into 
the print media receiving unit 2. There is also a earphone 
jack 22, for use if quieter operation if desired. In use, the 
user may place the tip of stylus 4 on a portion of the print 
medium and auxiliary information relating to the selected 
portion can be sent to the print media receiving unit 2 and 
may be audibly recited to the user, A wireless transceiver 
such as an RF transceiver 28 can be coupled to or embedded 
in the print media receiving unit 2. The RF transceiver 28 
may be used to couple the print media receiving unit 2 to an 
information server computer or to a client computer which 
contacts the information server computer. 

Auxiliary information can be loaded to or from the print 
media receiving unit 2 using a writeable memory such as a 
flash memory cartridge (not shown) or other transferable 
information storage media. A flash memory cartridge, for 
example, fits in a slot 24 at the side of the print media 
receiving unit 2. The cartridge may contain auxiliary infor- 
mation. 

As noted above, a gradient of selectability may be pro- 
vided so that resolution of the selectability of the selectable 
elements may be greater at one region of the print element 
receiving unit than another. For example, with reference to 
FIG. 7, the icons 18 are larger than, and have more distance 
between adjacent icons than the alpha-numeric elements 15 
on the print media receiving unit. Both the alpha-numeric 
elements 15 and the icons 18 may be printed on the surface 
of the print media receiving unit 2, The number of selectable 
positions at the region where the alpha-numeric elements 15 
lie is greater than the number of selectable elements where 
the icons 18 lie. Accordingly, in embodiments of the 
invention, a gradient of selectability may be provided to the 
print media receiving unit 2. Preferably, the gradient of 
selectability can be changed by modifying the location 
detection software used in the receiving unit 2 without any 
hardware modifications. 

Another embodiment view of another print media receiv- 
ing unit embodiment is shown in FIG. 8, In FIG. 8, a print 
media receiving unit 2 has a print medium 101 disposed on 
it. The print media receiving unit 2 may have a menu bar 
105. The menu bar may have the following icons: an icon to 
purchase a product 105(a), an icon to send an e-mail to the 
user's account 105(6), an icon to send an e-mail to another 
person 105(c), an icon to obtain more information 105(d), an 
icon to play a game 105(f), an icon to take a poll 105(/), an 
icon for help 105(^), an icon to send information through 
regular mail 105(/i), icons 105(i-j) for answering yes or no 
in response to questions, and icons corresponding to poten- 
tial answers provided by a user 105(k-n). A data entry bar 
150 may be present and may include: elements which can be 
selected to increase or decrease the volume 150(a), elements 
by which the user can inform the unit 2 that he is viewing 
the front cover (FC) or back cover (BC) 150(fc), and numeri- 
cal elements 150(c) for the user to enter in the page 
numbers) being viewed. As shown, the menu bar 105 and 
the data entry bar 150 are displayed to the user while the 
print on the print medium 101 is displayed to the user. 

A number of functions can be performed with the menu 
bar 105 and the data entry bar 150. For example, in some 
embodiments, a portion of text 107 can be selected can "cut" 
by passing a stylus (not shown) over the portion of text 102. 
This cut text 107 can then be sent to the user's e-mail- 
account by selecting the e-mail icon 105(6) on the print 
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media receiving unit 2. A selectable symbol 110 may be 
present on the print medium 101 to indicate to the reader that 
the symbol is selectable. Unlike a machine readable symbol 
such as a bar code, the symbol 110 may be aesthetically 
pleasing since its selectability does not depend on the 5 
particular geometry of the symbol 110 itself. In this instance, 
the selectable symbol may be associated with a URL 
(uniform resource locator) 108. The user may select the 
symbol 110 and then select the e-mail icon 105(6) to send an 
e-mail to the user with a hyperlink to the URL. 10 

Although the menu bar 105 and the data entry bar 150 are 
shown as being on the print media receiving unit 2, they 
could also be on the print medium 101. It is preferable, 
however, to have one or both of the menu bar 105 and the 
data entry bar 150 on the print media receiving unit 2. For 15 
example, by providing these bars on the print media receiv- 
ing unit 2, the bars need not be printed on the print medium 
and need not clutter the appearance of the print medium. 
Moreover, by providing these bars on the print media 
receiving unit 2, fewer selectable print elements per page 20 
can be provided. As noted above, when fewer selectable 
print elements per page are provided, the registration accu- 
racy needed when placing a print medium 101 on the 
receiving unit 2 is decreased. 

25 

EXAMPLES 
Example 1 

In one example, with reference to FIG. 8, the print media 3Q 
receiving unit 2 is designed to accommodate a magazine 101 
such as Time™ magazine. The magazine has been prepared 
by a publisher, and data of the prepared publication is 
entered into the information server computer 10. The infor- 
mation server computer 10 is preferably capable of obtain- 35 
ing auxiliary information which may relate to the print 
elements in the magazine being viewed by the user. The 
magazine may have been prepared for the system in advance 
of the user's receipt of the magazine or may be prepared 
after the receipt of the magazine. When the magazine is 4Q 
prepared, the magazine has an identifier such as a code 
and/or a publication name and date, as well as auxiliary 
information such as audio files associated with print ele- 
ments in the magazine. 

To use the prepared magazine, the user locates the iden- 45 
tification code printed on the magazine and enters it into the 
print media receiving unit using the alpha-numeric pad on 
the print media receiving unit. The print media receiving 
unit communicates with an information server computer via 
a Web site on the information server computer. This may be 50 
done using an intermediate client computer, or may be done 
using a processor in the print media receiving unit which can 
serve as a client computer. Data for the specific user, the 
print media receiving unit, and the specific magazine is 
uploaded into an information medium accessible to the 55 
information server computer. The print media receiving unit 
is registered at the information server computer using the 
identifiers and is associated with a user profile. In the 
personal profile, the user may have previously provided 
personalized information to the information server computer 60 
expressing an interest in wines. 

Data is sent from the information server computer 10 to 
the print media receiving unit 2. A speaker in the print media 
receiving unit or sounds coming from an earphone coupled 
to the print media receiving unit greets the user by name and 65 
recites the name of the magazine being viewed. Having 
previously expressed an interest in wines, the sound of a 
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voice coming from the print medium receiving unit brings 
the user's attention to an article on wines in the magazine. 
The user turns to the wine article and sees a boxed inset on 
pinots, describing several different processing methods for 
pressing the grapes. A stylus 4 is used to select a symbol 102 
in the insert box to and hear information on details of the 
different pressing methods described by a wine maker. The 
selection information may be sent to the information server 
computer 10 and the information server computer 10 may 
retrieve auxiliary information regarding wine making. For 
example, sound files can be downloaded into the print media 
receiving unit 2. The user can be asked by the system if he 
would like to order sample bottles made by each of the 
processing methods shown in the magazine. Using the stylus 
4, the user responds affirmatively and selects a number of 
bottles displayed in the magazine 101 for purchase. The 
print media receiving unit 2 may respond by displaying or 
reciting the price to the user. Using the print media receiving 
unit 2, the user may inform the information server computer 
10 to have the shipment sent to a work address to avoid 
having the shipped bottles sit in the afternoon sun until the 
end of the day. 

In some embodiments, the user may be tested on the 
subject matter provided by the article in the print medium. 
The user may be given a pop quiz such as a multiple choice 
test to test the user on his retention of the subject matter of 
the article in the print medium. For instance, in this particu- 
lar example, the user can be tested with multiple choice 
questions on the subject matter of the wine article recently 
read. Consequently, embodiments of the invention can assist 
a user in retaining information that he has read. 

In some embodiments, the user may also select a symbol 
to have the print media receiving unit recite the main points 
of the article before the user reads the article. In this way, the 
user can listen to the key points of the article before deciding 
to spend the time to read the article. For instance, in this 
particular example, the user can select a symbol which lets 
the user listen to a summary of the article on wines. After 
listening to the summary, the user can determine if he wants 
to read the article. 

Example 2 

The printed media used may comprise strong, long-lasting 
plastic sheets containing game board designs along with 
printed codes specifying the game and level of interaction. 
For example, the printed medium may resemble a chess 
board and printed icons indicating different difficulty levels 
(e.g., levels 1 through 5) may be listed in the margin of the 
printed medium. A level of skill can be selected by the user. 
The printed medium may be placed on a print media 
receiving unit and chess pieces can be placed on the printed 
medium. Position sensors in the print media receiving unit 
can sense the position of particular chess pieces. This 
location information can be transmitted to the information 
server computer. When the user moves a chess piece, the 
print media receiving unit can determine the new location of 
the chess piece and the new location information can be sent 
to the information server computer. Consequently, in these 
game embodiments, the user may play a game with another 
player or may play a game with the information server 
computer. The user has a choice of playing in real time or 
playing by logging game moves and sending the move to 
another player who will pick up the game at a convenient 
time to check an opponent's last move, and subsequently to 
enter a move. 

Example 3 

A person may electronically prepare a personalized birth- 
day card to make certain items on the birthday card select- 
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able when the birthday card is placed on the print media 
receiving unit. For example, the birthday card when placed 
on a print media receiving unit, the user may select items on 
the birthday card and the print media receiving unit may 
respond by generating a special song or reciting a personal 
spoken message from the sender. The card may offer dif- 
ferent gift certificates to the user and may choose a gift 
certificate from the gift certificates printed on the card. Upon 
selection of a gift certificate, the gift certificate can be 
automatically sent to the user. 

Example 4 

A family in which members live some distance from one 
another could share a photo album, with associated spoken 
annotations. Family members can obtain a user-oriented 
toolkit to electronically process the photo album to make 
certain elements of the photo album selectable when it is on 
a print media receiving unit. Upon selection of certain 
elements in the photo album, new photos and comments may 
be presented to the user. Each time a family member places 
his album in the print media receiving unit, it would down- 
load the latest photos and comments entered by any other 
family member. 
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Example 5 

Information can be requested real time using embodi- 
ments of the invention. For example, the user can touch a 
map on the print media receiving unit to hear weather 
conditions or may place a TV guide on the print media 
receiving unit to hear reviews or viewing times for a listed 
program. The user may also select portions of a printed 
medium on a print media receiving unit to listen to excerpts 
of recorded music from a play, movie, or compact disc. 

Example 6 

A print medium can be placed on a print media receiving 
unit. The print medium may display ads for service busi- 
nesses such as a realtor or an auto-dealer. By touching 
portions of the ads, the user can request that the realtor or 
auto dealer send information to the user by e-mail, conven- 
tional mail, or phone. Information on a single topic, like 
cars, catalogs, or magazines could be saved for later com- 
parison. Contests or sweepstakes could be carried out with 
a real time response using embodiments of the invention. 

Example 7 

Users could register for events by filling in processed 
forms that were received by conventional mail. They can be 
placed on a print media receiving unit and the elements of 
the forms can be selected to provide registration information 
to the information server computer. 

Example 8 

A user places a magazine on the print media receiving 
unit, and touches the stylus to, e.g., an advertisement for a 
theater show in the magazine, electronics in the print media 
receiving unit will identify the print item selected by the 
user. The selected information can be sent to an information 
server computer which retrieves information from an infor- 
mation source such as an information database and sends it 
to the user. The information sent to the user may be ticket 
information (e.g., prices) and show schedules. The sent 
information may be digital and may be in the form of a 
sound file or text file. After the print media receiving unit 
receives the data transmitted from the information server 
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computer, a speaker in the print media receiving unit audibly 
recites the days certain tickets are available and their price 
to the user. The user may also purchase the tickets by 
contacting the information server computer using the print 
media receiving unit. 

The terms and expressions which have been employed 
herein are used as terms of description and not of limitation, 
and there is no intention in the use of such terms and 
expressions of excluding equivalents of the features shown 
and described, or portions thereof, it being recognized that 
various modifications are possible within the scope of the 
invention claimed. Moreover, any one or more features of 
any embodiment of the invention may be combined with any 
one or more other features of any other embodiment of the 
invention, without departing from the scope of the invention 

We claim: 

1. A print media information system comprising: 

(a) a portable print media receiving unit assembly includ- 
ing 

(i) a platform including a surface and a print medium on 
the surface, 

(ii) an electronic position determining system capable 
of determining a position of a selected portion of the 
print medium using an electronic map that correlates 
print elements in the print medium with their loca- 
tions in the print medium when the print medium is 
disposed on the surface, wherein the electronic posi- 
tion determining system includes a processor, 

(iii) an audio output device coupled to the processor, 
and 

(iv) a write able memory device coupled to the 
processor, wherein the audio output device and the 
processor are included in the platform in the portable 
print media receiving unit assembly; and 

(b) an information server computer adapted to send aux- 
iliary information to a user via the Internet after receiv- 
ing the information relating to the position of the 
selected portion of the print medium, and wherein the 
information server computer is also adapted to transmit 
the electronic map that correlates the print elements in 
the print medium with their locations in the print 
medium to the user via the Internet for use in the 
portable print media receiving unit assembly, 

wherein the writeable memory device is adapted to 
receive and store the auxiliary information from the 
information server computer and store the electronic 
map that correlates the print elements in the print 
medium with their locations in the print medium. 

2. The print media information system of claim 1 wherein 
the information server computer is adapted to perform a task 
after receiving the information relating to the position of the 
selected portion of the print medium. 

3. The system of claim 2 wherein the task comprises 
retrieving auxiliary information relating to the selected 
portion of the print medium; and 

wherein the audio output device is adapted to communi- 
cate the auxiliary information. 

4. The system of claim 1 wherein the print media receiv- 
ing unit assembly further comprises a stylus, and wherein 
the processor is programmed to identify an area where the 
stylus is positioned. 

5. The system of claim 2 wherein the task comprises 
retrieving auxiliary information relating to the selected 
portion of the print medium; and 

wherein the audio output device is a speaker or an audio 
jack. 
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6. The system of claim 1 wherein the audio output device 16. The method of claim 9 wherein the electronic map is 
is a speaker or an earphone. a first electronic map and the print medium is a first print 

7. The system of claim 1 wherein the print media receiv- medium, and wherein the method further comprises: 

ing unit assembly further comprises a visual output device. transmitting a second electronic map that correlates print 

8. The system of claim 1 wherein the print media receiv- 5 elements in a second print medium with their locations 
ing unit assembly further comprises a voice generator. m me second print medium to the user via the Internet. 

9. A method of augmenting a print medium, the method 17. The method of claim 9 wherein the print medium is a 
comprising: magazine. 

, x , , . „ . c 4 . « 4 . 18. The method of claim 9 wherein the electronic map is 

(a) electronically encoding information relating to por- transmitted to a client ter tcd 5 mc user 

tions of the print medium; and 10 19. The method of claim 9 wherein the electronic map is 

(b) transmitting the information relating to the portions of transmitted to a client computer operated by the user and 
the print medium to a user via the Internet using a wherein the user thereafter loads the electronic map into the 
server computer, wherein the transmitted information is writeable memory device using the client computer and then 
to be used in a portable print media receiving unit inserts the writeable memory device into a housing of the 
assembly comprising 15 print media receiving unit assembly. 

(i) a platform including a surface with the print medium 20. The method of claim 9 wherein the print medium is a 
on the surface, children's book. 

(ii) an electronic position determining system capable 21. The method of claim 9 wherein the print medium 
of determining a position of a selected portion of the includes a number of selectable print elements that have an 
print medium using an electronic map that correlates 20 appearance different than non-selectable print elements in 
print elements in the print medium with their loca- the print medium. 

tions in the print medium when the print medium is 22. The method of claim 9 wherein the auxiliary infor- 

disposed on the surface, wherein the electronic posi- mation comprises music or voice data. 

tion determining system comprises a processor, 23. The method of claim 9 wherein the print medium was 

(iii) an audio output device coupled to the processor, 25 obtained by the user through a subscription. 

and 24. The method of claim 9 wherein the surface is part of 

(iv) a writeable memory device for storing the elec- a platform that has a center, the platform being hinged at the 
tronic map, the writeable memory device being center. 

coupled to the processor, wherein the audio output 25. The method of claim 9 wherein the print media 

device and the processor are included in the platform 30 receiving unit assembly has a strip of numbers so that the 

in the portable print media receiving unit assembly; user is able to select a page number for the print medium. 

wherein the information relating to portions of the print 26. The method of claim 9 wherein the electronic position 

medium includes auxiliary information relating to a determining system includes an antenna system, 

print element in the print medium and wherein the 27. The method of claim 9 wherein the electronic position 

method further comprises 35 determining system includes pressure sensitive switches that 

transmitting the electronic map that correlates print are under the surface. 

elements in the print medium with their locations in 28. The method of claim 9 wherein the writeable memory 

the print medium to the user via the Internet for use device comprises a flash memory device. 

in the portable print media receiving unit assembly. 29. The method of claim 9 wherein the print medium is a 

10. The method of claim 9 wherein the print media 40 publication and wherein (a) and (b) are performed by a 
receiving unit assembly further comprises: publisher of the publication. 

a numeric input region disposed to a side of the surface for 30- Th e method of claim 9 wherein the print medium is a 

permitting the user to enter data. publication and wherein (a) is performed by a publisher of 

11. The method of claim 9 wherein the electronic position 45 me publication and (b) is performed by a host entity, 
determining system includes a plurality of antennas. 4 31. The method of claim 9 wherein the print medium is in 

12. The method of claim 9 wherein the print media ^e form of a single sheet. 

receiving unit assembly further comprises an alphanumeric 32. The method of claim 9 further comprising receiving at 

keyboard disposed to a side of the surface. tne server computer information relating to a selected por- 

13. The method of claim 9 wherein the print media tion of the print medium and then performing a task after 
receiving unit assembly further comprises: receiving the information relating to the selected portion of 

a plurality of selectable icons disposed to a side of the me P riDt medium usin S me server com P uter - 

surface 33. mem °d of claim 9 further comprising sending the 

14. The method of claim 9 wherein the print media P rint medium to user mrou eh the U.S. mail 

receiving unit assembly further comprises: 55 34 * . The method ° f cla ^ 9 wherein me P rint media 

, r , i- i , u, • t . . , receiving unit assembly and the print medium on the surface 

a plurality of selectable icons disposed to the side of the „„ „„J\„-*u , * u • • a- * ■ *• *u *u 

£ i r are used without being in direct communication with the 

surface; and . 

* server computer. 

a numeric input region for allowing a user to input data 35. ih e me thod of claim 9 wherein the writeable memory 

into the print media receiving unit, and device ^ a removable writeable memory device. 

wherein the electronic position determining system 60 36. The method of claim 9 wherein the surface is planar, 

includes a plurality of antennas. 37. The method of claim 9 wherein the print media 

15. The method of claim 9 wherein transmitting the receiving unit assembly further comprises a stylus, 
information relating to the portions of the print medium to 38. The method of claim 9 further comprising a voice 
the user comprises transmitting the information relating to synthesizer in the platform. 

the portions of the print medium to an e-mail account of the 65 • 
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